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Abstract 



We present easily computable bounds on the extreme generalized eigenvalues of Hermitian pencils 
with finite eigenvalues, and positive definite matrices. The proposed bounds are 
derived in terms of the generalized eigenvalues of the subpencil of maximum dimension 
contained in ^n+i)- 

Known results based on the generalization of the Gershgorin theorem and norm inequalities arc 
presented and compared to the proposed bounds. It is shown that the new bounds compare 
favorably with these known results; they are easier to compute, require less restrictions on the 
properties of the pencils studied, and they arc in an average sense tighter than those obtained with 
the norm inequality bounds. 
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1.0 Introduction 



'I’he Hcrmitian (regular or generalized) cigenproblem occurs in a variety of applications in signal 
processing. It is commonly encountered in array processing [1,2,3]» in spectral estimation [4], 
filtering [5], and other areas. Different bounds for the extreme eigenvalues of the regular Ilermitian 
problems have been presented in the literature [6,7]. Some of them have then been extended to 
the generalized Ilermitian cigenproblem by either back transforming the generalized problem into 
the corresponding cigenproblem, or by generalizing the results originally derived for the regular 
cigenproblem [8]. Classical bounds derived using norm inequalities can be extended to the 
generalized positive definite cigenproblem by backtransforming the pencil {R,B) into a regular 
problem {C ^RC~\I) where B—CC\ However, such a transformation requires the Cholcski 
decomposition of B. The generalization of the Gershgorin theorem proposed by Stewart [8] docs 
not have such a restriction, but the tightness of the bounds depends strongly on the characteristics 
of the pencils under study. 

Here we present new bounds for the extreme generalized eigenvalues based on an order-recursive 
cigenproblem decomposition. This work can be considered as an extension of the ideas of Slepian 
ct al [9] and Dembo [10] who considered the regular cigenproblem. The original idea behind the 
following work is connected to the derivation of the order-recursive RITF [1 1] and C-RITlv [12] 
algorithms. I'hesc algorithms take advantage of the interlacing property [6]: 

^ 1,^+1 - ^\, n ^ ^ 2 , n +] — *" — 

where 2,^^^ is associated with the (;? -h 1)'^' dimensional pencil and is associated with 

the n-dimensional subpcncil {R„, B„) contained in {Rn^y B„^^). This property allows us to define 
intcr\^als in which found via iterative search techniques [12,13], However, 

the interlacing property docs not provide an upper bound on the largest generalized eigenvalue or 
a lower bound on the smallest generalized eigenvalue. The proposed bounds on the extreme 
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eigenvalues fake advantage of the infonnation available at the previous order (assumed to be 
known), and are easy to compute. 
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2.0 Derivation of the new bounds 



Ixt S„,i) be a (n+ l)-dimcnsional Ilermitian pencil with finite eigenvalues. Let us assume 

that the generalized eigenvalues of {R„, B„) arc known. The eigenvalues A associated with the pencil 
satisfy the relation: 

det(/?„+, -;V,) = () (1) 



which can be expressed as: 



det 



''0 - 
r — }h 




( 2 ) 



rhcreforc, using [6] the determinant of the extended pencil {Rnw^nw) expressed as: 

DBT = <lct[(/?„ - AB„){ro - ~ {s - Aq) - Ar)~\s - Aq))\ 

= dct[/?„ - ;./?„]det[ro - Ab^ - {s - Aq) - Al)~\s - Aq)\ 



with s—U'„r, and q—U'^h, where (/„ = [i/,, is the B-orthonormalized eigenvector matrix 
associated with (R„, B„). 1 he eigenvalue search function h{A) is defined as: 



h{A) = 



DFT 

det[jR„ - ;/?„] 



(4) 



Lxpanding (4) leads to: 



h(A) = (ro-Aho)-y 






(5) 



with = {Sf, — where = ulr and qf^ = ulh. 7'he zeros of (5) are the generalized eigenvalues 
of the increased order pencil I'he function / 2 (A) is monotone decreasing between its 

poles, as shown in Appendix A. Note that similarly to the regular eigenproblcm [9,14], / 2 (A) fails 
to have (n+ 1) real roots only when it has less than n distinct poles. This happens when 
{Rnw^ ^n\\) multiple eigenvalues, or when = 0 for some k. Slcpian et al [6] indicated that 
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three possible situations related to the multiple eigenvalue case can occur for the regular 
eigenproblein. These comments can be extended to the generalized problem. be an 

eigenvalue of (/?„, with multiplicity k. If (.9^, = (0,0) for p = m , ... + k, and is not a root 

of h{X)y then X„„ is an eigenvalue of multiplieity k for the (n+1) dimensional pencil. If 
= (0,0) for p~m , ... ,m + k, and X^^ is a root of /t(A), then „ is an eigenvalue of multiplicity 
A: -f 1 for the (/z-fl)'* dimensional pencil. Finally, if (-y^,, <?^) ?^ (0,0) for some p where 
m<p<m^- k, then X^^ is an eigenvalue of multiplicity A — 1 for (/?„n» ^nw)- 

The idea now is to find a lower bound on and a higher bound on by approximating 

the rational portion of the eigenvalue seareh funetion. To that end we note that: 




(6a) 



and 




7’hus from (6) we get 

h(X) > = /‘o - for ( - oo, 

/'W</W^-) = ro-/!6o-f^max(^) for 






{la) 

(lb) 



As shown in Appendix A, the function is monotone deereasing in ( — oo, A, ,,), and /imax(^) 

is monotone decreasing in (A^^, co). Thus, An,jn(^) ^ root X,^^^ in the interval ( — co, Aj ,,) such 
that An,in<Aj^^], as illustrated in I'igure 1. Similarly, /tmax('^) has a root A„,ax hi the interval 
(A„^, oo) such that A^^,, > 7'he roots and A„,a,^ can easily be computed by solving for the 

roots of the second order polynomials: 

h {X) = {r^-Xb^){rj-X)- \s-Xq\^ 

. - ( 8 ) 

= X [niQ - 1^1) + ^.(2rcal(.f <?) - ro - niQtj) + ro»J ~ l-^l = 0 
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for Yi = /l,,„ or ^ 

Note that for the regular eigenproblem, where /? = /, (8) becomes: 

X rriQ-\- X{ — rQ — + Tq?; — 1 5 1 = 0 (9) 

which is the same expression as the one obtained by Slepian et al [9] and by Dembo [10]. 
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3.0 Comparisons with known bounds 



This section first reviews two types of known bounds on the extreme generalized eigenvalues of 
pencils, and next presents some comparisons of the proposed bounds with classical results based 
on norm inequahties. 

The generalized Gershgorin theorem 

Stewart [8] derived a generalization of the.' Gershgorin theorem and showed that the generalized 
eigenvalues of Rx = XBx lie in the union of the neighborhoods G, defined as: 

where 

A W^iiPi ~ 

= r^r= =^ (10) 

V I '//I T I \I ^ n + 

with 

’ ••• ’ ^ ij—] ’ “■ ’ Pi ~ (^/l ’ ••• ’ PiJ—] 

r'ii= max[0, |r,;| -||«;||,) (11) 

6^ =max{0, Ib^l -1|)?/||,] 



X') is the chordal distance between X and X’. It is defined as the length of the chord joining the 
points a and b located on the Riemann sphere [15,16], as shown in Figure 2. 
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Several eomments can be made here: 



1. A tighter bound may be obtained by replaeing in norm 1 with norm 2, as shown in 
Appendix B. 

2. A finite value for p,- is obtained only when (r',,, = (0,0), or when (r,„ = (0,0). Note that 

(^/v» ^'iv) ^ (0,0), requires that at least one of the matrices of the pencil (R,B) to be diagonally 
dominant’ . Thus, p, may be infinite when at least one of the matriecs of the pencil studied 
(/?,/?) is not diagonally dominant and no restrictions on the diagonal elements of the pencil are 
made. This indicates that the bounds obtained via the Generalized Gershgorin (G.G.) theorem 
arc not insured to be finite in all situations where the pencil has finite eigenvalues. 

3. The chordal distance has a maximum value of 1 [16]. I hus, a finite Gershgorin 

neighborhood is obtained only when p,< 1. The value of the parameter p, defined in (10) 
depends on the pencil (R.B), it can have values larger than 1 even when the pencil eigenvalues 
are finite. In such a case, the regions (7, containing the eigenvalues cover the whole space, and 
no new information is gained by applying the G.G. theorem. 

The above comments indicate that, when dealing with pencils with finite eigenvalues, additional 
information can be gained from the G. G. only when p,< 1 for all /. fhis further restricts the 
usefulness of the G.G. theorem. By comparison, the proposed bounds arc limited only to 
llermitian pencils (R,B) with positive definite B matriecs. Furthermore, the bounds arc insured to 
be finite when the origin;)! pencil has finite eigenvalues to start with. 1 hcrefc^rc, the G.G. bounds 
will not be used in the following statistical comparisons because they require too many restrictions 
on the pencils studied in order to bring additional information. 

Norm Inequality bounds 

Bounds on the extreme eigenvalues of the regular eigenproblcm Ax = Xx based on norm 
inequalities have been proposed [6,7]. Recall that for such bounds, we have: 

* I'he matrix R is diagonally dominant if |r„| > XI I ''//I h)*" 

./V' 
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1 



( 12 ) 



^n+\,n+\ ^ W'^Wr 
'^/j+1,n+l — 



'-l./i+l - 



JirT^WA 



-111 



The above inequalities can be extended to the generalized eigcnproblem by backtransforming the 
pencil {RyB) into {C~^RC-\I) when B= CC is positive definite. It was not possible to perform an 
analytical comparison of the new bounds with the norm inequality bounds. As a result, the 
behavior of the bounds was studied statistically using simulations. 

7’he errors between computed bounds and the true eigenvalue arc defined as: 



err„ 



eiTn 



err„ 



'^min 



'^max ” ,/?4-l 

I } I 

' 1,^+1 ' 

^normp~ 





















^norm^ 

I I 



(13) 



where and P^iax ^^e the eigenvalue bounds proposed using the order-recursive technique. 
^normp ^^d arc the upper bounds respectively obtained using norm F and norm 1, as defined 
in (12). 2„^,„,.^is the lower bound obtained using norm infinity, as defined in (12). 

We considered pencils in which the elements arc randomly generated from a uniform distribution. 
Note that bounds derived using matrix norm inequalities are only valid with positive definite 
pencils. I'hus, in order to compare the proposed bounds with the matrix norm inequalities bounds, 
the eigenvalues of {RyB) arc shifted to insure that the pencils under study are positive definite. Table 
1 presents the means and standard deviations obtained for the error measures defined in (13). 3000 
randomly generated positive definite pencils were used to generate the results in each case. This 
table shows that the proposed bounds arc tighter than the norm inequality bounds in an average 
sense only, i.e., the relative tightness of the bounds around the true eigenvalue depends upon the 
pencil under consideration much more than the norm inequality based norms. Furthermore, the 
results indicate that the larger the eigenvalues arc, the better the performance of the proposed 
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is. Note that >3^.^ is not bounded by 0, as is and can be negative, d herefore, the likelihood 

of < 0 increases when the true eigenvalues are close to 0 to start with. 



Table 1 . Bound error measures 



average min & 
max eigenv. 




CfT 


^^max 




CfT 

' maxp 




mean 


(Stc 


indard deviation 


) 


28.677 

3079 


0.5381 

(2.1267) 


0.7089 

(0.0225) 


0.2813 

(0.4057) 


0.3282 

(0.1194) 


0..5016 

(0.3109) 


219 

10978 


0.5730 

(1.4311) 


0.7913 

(0.0156) 


0.4356 

(0.6020) 


0.5005 

(0.138.3) 


0..5730 

(0.3724) 


8407 

3.6105 


0.1631 

(0.0771) 


0.7884 

(0.0166) 


0.4356 

(0.6450) 


0.4771 

(0.1486) 


0.6485 

(0.4410) 
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h(A): 



KM)- 



Figure 1. Eigenvalue search function li(A), and bound search functions h^.^(A), and h^^^(A) 
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II 



oo 




x(/l, /I') = d[a,b) 



Figure 2. Definition of the Chordal distance: from Parlett [15] 
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4.0 Conclusions 



This report presents new bounds on the extreme eigenvalues of llermitian pencils (/?,/?) with finite 
eigenvalues, when D is positive definite. fhe bounds are based on an order-recursive 
eigendeeomposition of the pencil. Simulations indicate that the proposed bounds depend more 
strongly on the pencil considered than those derived using norm inequalities. However, they are 
not as restricted and are easy to compute. 
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Appendix A. Monotone behavior of the eigenvalue 
search function, and the bound search functions 



I'his appendix shows that the generalized eigenvalue search function h{X), and the bound 
functions and /imax(^) monotone decreasing between their poles. 

Proof: 

Recall from (5) that the eigenvalue sSearch function is defined as: 



h{X) = r^-kb^-Y^ 

/f=1 



I I 

^k,n ~ ^ 



Consider the following matrix equation: 



— 1 

1 


1 

# 

1 

* 


C 




1 


1 

1 


1 

1 

< 






_o_ 



with A = diag(/l,„ ... , Solving equation (A. 2) for C leads to; 

C(2) = [r„ - 26,, -{s- Xq)\^ - XI)~\s - 

= w^)r' 



C{X) may be rewritten as: 

C(2) = e*(^-25)"'e, 
with 

Appendix A. Monotone behavior of the eigenvalue search function, and the bound search 
functions 



search 



(A.I) 



(A.2) 



(A.3) 



(A.4) 
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C, = [1,0,...,0]' 



A 

R = 


’'0 


* 

s 


A 

B = 


bo 


* 




X 


A_ 




_ (} 


/ 



SO that from (A. 4) we get: 

C'(A) = c1{R - - A/y)~'c, > 0 (A.5) 

Using (A. 3) and (A.5), h'{X) becomes: 




'rhcrcforc, h{).) is monotone decreasing between its poles. 

Next, note that and arc functions similar to /i(A) in which A has been respectively 

replaced with diag(A, ... , Aj „) and diag(A„„, ... , Thus, and A„,ax(^) monotone 

decreasing between their respective multiple poles and 
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Appendix B. Generalized Gershgorin bounds 



This appendix first reviews the generalized Gershgorin neighborhoods proposed earlier by Stewart 
[8]. Next, it shows that further tightness of the eigenvalue bounds may be obtained by replaeing 
the norm I measure used by Stewart with the norm 2 measure. 



Generalized eigenvalues and the Chordal distance 

Some insight into the properties of the pencil (/?,/?) can be gained by looking at the Generalized 
Sehur (G.S.) decomposition [ 7]. Recall that the G.S. decomposition leads to the following result: 

Theorem: If R and B are in then there exists unitar}^ Q and Z such that Q^AZ — 1' and 
Q*BZ = S arc upper triangular. If for some k, and are both zero, then ?.{R,B) = C. Otherwise, 

X{R,R)=[t;ilS;i I (B.l) 

Equation (B.l) shows that 2(/?,/?) may be very sensitive to small changes if is small. However, 
Stewart [7] noted that the reciprocal may be a well behaved (i.e., not sensitive to small changes 
of its parameters) eigenvalue of the pencil (/?,/?), and pointed out that it may be better to treat the 
eigenvalues as pairs (/,,, .y„) than as quotients. As a consequence, Stewart [8] identified the 
eigenvalues X — tjs of pencils with the point in the projective complex line defined as: 

^ ( 0 , 0 ) ://5 = 2 } 



rhe Chordal metric^ x used to measure the eigenvalue separation. It is expressed as: 






\sC -Zt\ 



7ui'+ l/l'^/I7j^+ U'l' 



(B.2) 



2 This metric results from the introduction of the extended complex plane (complex plane + infinity) in 
complex analysis [16]. I he Riemann sphere is chosen to represent the extended complex plane which is 
not easy to visualize directly. The correspondence between the two geometric representations is then set 
up with the aid of a stereographic projection [16]. 
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Tor X = sjt and A' = s'jt' the ehordal distance ean be expressed as: 




(B.3) 



The distance ^') is the length of the chord joining a and />, as shown in b'igure 2. 

Some useful properties of the Chordal metric [16] 

1. The ehordal metric is invariant under reeiproeation; i.e., xi^^ ^'-1 ~ • 

2. The ehordal metric is bounded; i.e., 0<x(-^,^')< 1- 

3- xi^]i ^ 2 ) ^ T x('^3» '^ 2 )- 

4 . 

Generalized Gershgorin bounds 

Stewart [8, th. 2.1] showed that the generalized eigenvalues 1 of the pencil (R,B) lie in the union 
of the regions G, defined by: 



eigenvalue x by deleting its component. 

The sets G, are not easy to work with. I'hus, they are replaced with the following neighborhoods 
defined in tenns of the ehordal metric x- 1 his leads to: 



Cri = {[r,.,. + a]x, hii + p]x] : ||x||^ < l}, (/ = 1 , ... ,n) 



(B.4) 



where o:* = (r, ,. 



1 ’ • 



> ^>)i ••• » ••• » X is formed from the 



x(C'V,-. biil[rii + ajx, bii + p*ix]) = 




(B.5) 



Next, the sets G, arc defined as follows: 



: xin-j^ir ^ Pi) 



(B.6) 
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where is an upper bound on the chordal distance defined in (B.5). These regions G, contain the 
eigenvalues of the pencil they arc called the Gershgorin regions. Stewart [8] vshowed that the 

bound Pi introduced in (B.6) can be defined by: 



A imJ-vIiii 

J\ru\^ +\hy\^ Jr^l + bi 

where 

r',v = max{0, Ir^l -||«,||,j 
6',-; = max{0, -||/?,H,| 



Modified Gershgorin bounds 

A bound y, on the chordal distance tighter than the one proposed by Stewart with (B.7) can be 
derived by using the following vector norm inequality: 



IWl2<IWIi 



(B.8) 



Using (B.8) in (B.5) leads to: 



I Mi - Vi)-^ I ^ \hP] - Vllbll'^lb 



(B.9) 



and 



I • + (X,- X I > I - lotjxl I 



(B.IO) 



Note that 



Ir;,l - la-xl > |r;,-| - ||ajlbl|5’lb 



(B.ll) 



Thus, (B.8), (B.9), (B.IO), and (B.ll) lead to: 



X ('■«/*«. 'i) ^ Vi = 



IhiPi -*ii«/lb 



VlO(l^+ l^-il^ 



^Pi 



(B.12) 
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where 



r',-;=max{0, \ri,\ - IHlj} 
b'ii = max[0, \bn\ - 



Note that the G.G. bound y, is tighter than p, but similar comments to those made on p, apply. 
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